Journal of lUeuroEngineering and 
Rehabilitation 



O 

BioMed Central 



Research 

A novel asynchronous access method with binary interfaces 

Jorge Silva* 1 ' 4 , Jorge Torres-Solis 1 ' 23 , Tom Chau 2 3 and Alex Mihailidis 4 



Open Access 



Address: 'Komodo OpenLab, Toronto, Canada, 2 Bloorview Research Institute, Bloorview Kids Rehab, University of Toronto, Canada, institute of 
Biomaterials and Biomedical Engineering, University of Toronto, Canada and intelligent Assistive Technologies and Systems Lab, University of 
Toronto, Canada 

Email: forge Silva* - jorge.silva@komodoopenlab.com; Jorge Torres-Solis - jorge.torressolis@utoronto.ca; Tom Chau - tom.chau@utoronto.ca; 
Alex Mihailidis - alex.mihailidis@utoronto.ca 
* Corresponding author 



Published: 29 October 2008 Received: 1 8 February 2008 

Journal of NeuroEngineering and Rehabilitation 2008, 5:24 doi: 1 0. 1 1 86/ 1 743-0003-5-24 Acce P ted: 29 October 2008 
This article is available from: http://www.jneuroengrehab.eom/content/S/l/24 
© 2008 Silva et al; licensee BioMed Central Ltd. 

This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.Org/licenses/by/2.0 ). 
which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 



Abstract 

Background: Traditionally synchronous access strategies require users to comply with one or 
more time constraints in order to communicate intent with a binary human-machine interface (e.g., 
mechanical, gestural or neural switches). Asynchronous access methods are preferable, but have 
not been used with binary interfaces in the control of devices that require more than two 
commands to be successfully operated. 

Methods: We present the mathematical development and evaluation of a novel asynchronous 
access method that may be used to translate sporadic activations of binary interfaces into distinct 
outcomes for the control of devices requiring an arbitrary number of commands to be controlled. 
With this method, users are required to activate their interfaces only when the device under 
control behaves erroneously. Then, a recursive algorithm, incorporating contextual assumptions 
relevant to all possible outcomes, is used to obtain an informed estimate of user intention. We 
evaluate this method by simulating a control task requiring a series of target commands to be 
tracked by a model user. 

Results: When compared to a random selection, the proposed asynchronous access method 
offers a significant reduction in the number of interface activations required from the user. 

Conclusion: This novel access method offers a variety of advantages over traditionally 
synchronous access strategies and may be adapted to a wide variety of contexts, with primary 
relevance to applications involving direct object manipulation. 



Background 

Many Disabled individuals require custom interfaces that 
enable them to access the devices they may wish to con- 
trol. When appropriately designed, such interfaces take 
advantage of the user's known abilities, while eliminating 
reliance on onerous operational requirements. Thus, the 
design of appropriate user interfaces for Disabled individ- 



uals involves a process of understanding the needs, chal- 
lenges and abilities of each user. In order to facilitate this 
process, it is necessary to count on widely available and 
highly adaptable tools that may be customized and com- 
bined in order to obtain the most appropriate solutions in 
each case. One such tool is the binary interface (com- 
monly represented as a button or a switch), which, due to 
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its simplicity and adaptability, has become a ubiquitous 
resource to overcome barriers to access for Disabled peo- 
ple. 

A binary interface is formally defined as a device that may 
present only one of two distinct and stable states at any 
given time (e.g., on/off), which may be used to convey 
information between two entities [1]. Moreover, accord- 
ing to basic principles of information theory, binary inter- 
faces are in fact the simplest possible means through 
which a user may communicate intent, since they repre- 
sent the basic unit of information, namely, the binary 
digit or bit [2]. Therefore, binary interfaces may also be 
termed minimal interfaces. Minimal interfaces for Disa- 
bled users include other means of communication charac- 
terized by a low information storage (i.e., memory) 
capacity, this is the case, for example, with most brain- 
computer interfaces (BCI) currently available [3,4]. 

The problem of binary access 

In order to communicate intent through a binary inter- 
face, a user must be able to intentionally determine, 
whenever necessary, which of the two possible states the 
interface should present. Thus, for example, in the case of 
a button, the user must be able to intentionally perform 
the mechanical actions required to press and release the 
button. Other binary interfaces may, for example, exploit 
the user's ability to produce a gesture [5] or blink [6] at 
will. 



More recently, researchers have explored the detection of 
voluntary changes in physiological activity, such as brain 




[7] or electrodermal activity [8], in order to obtain a few 
distinct and repeatable patterns that, similarly to binary 
interfaces, may be used to communicate intent. These 
novel approaches may provide a means of access for those 
users whose intent may not be understood otherwise. 
Some of these physiological interfaces, although still min- 
imal, are capable of respresenting more than 1 bit of infor- 
mation at once, however, due to a variety of design, 
measurement and contextual challenges, their implemen- 
tation is generally simpler and more effective when only a 
binary mode of use is required. 

In spite of all these advantages, binary interfaces also 
present significant limitations that preclude their use in a 
wide variety of access and control applications. Evidently, 
the binary nature of these interfaces makes them an ideal 
solution for the control of devices with intentional spaces 
that present only a dyad of possibilities (e.g., close-open, 
up-down, etc.) However, when access to more than two 
distinct outcomes is required for the successful control of 
a device, the limitations of the binary interface become 
immediately apparent. Figure 1 depicts this dilemma 
where a user is required to control a complex device by 
means of a binary interface. 

Protocol-based binary access 

Consider the set S = {s 0 , s v s 2 ,—,s g . 1 } containing all ^states 
available in a typical interface. Note that, with a binary 
interface, g = 2. This interface, is used to access the set C = 
{c 0 , c v c 2 ,..., c kA } of size k, containing all possible out- 
comes available for selection. The initial limitation of the 
case k > g is typically overcome by the implementation of 




User Interface Device 

Figure I 

The problem of access with binary interfaces. A user is required to communicate intent, by means of a binary interface, 
to a device capable of more than two outcomes. 
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a time-bound protocol that enables the generation of a 
new set S T = {f 0 [t), f x {t), f 2 {t),...,f KA (t)} where each ele- 
ment e S T is a time-dependent function composed by 
a unique sequence of channel states s, e S with duration T 
. This time-based coding enables the direct mapping of 
each member /j(t), of the newly created set of functions S T , 
to a unique message c, e C. Figure 2 shows two sample 
periodic state sequences f t (t) used to communicate mes- 
sages through a binary interface (i.e., g = 2). The top 
sequence represents the hexadecimal number 9A H£X as 
defined by the RS232 serial communication protocol. The 
bottom sequence represents the letter 'X' as defined by the 
Morse code. Evidently, there are significant similarities 
between early electronic communication challenges and 
the use of binary interfaces by Disabled users. These simi- 
larities were quickly identified by interface designers who 



fM 



S \- 

J 



transferred the application of time-bound communica- 
tion protocols to the implementation of access solutions 
for the Disabled. In fact, Morse-based communication 
and computer access methods are still being actively 
researched [9,10]. 

There are, however, some significant disadvantages with 
the use of time-bound protocols in the control of a device 
by a human operator. These stem mainly from the fact 
that both the transmitting and the receiving end must 
comply with the protocol used in the communication 
process. This requires users to either memorize all pairs 
{/;(£), c,} mapping every device outcome c { e C to its cor- 
responding sequence /;(t) e S T , or learn the time-coding 
rule g(t) : f { (i) — > c, that may be used to generate the i-th 
sequence f^t) e S T corresponding to the desired outcome 
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Figure 2 

Sample state sequences f ( (t) used to communicate a particular message through a binary channel. The top trace 
represents the hexadecimal number 9A i6 in the RS232 serial communication protocol. The bottom trace represents the letter 
'X' in Morse code. 
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c, e C. Evidently, depending on individual abilities, this 
requirement will affect different users to varying degrees. 
However, the number k of device outcomes that can be 
made available to the user will be largely limited by the 
user's memory capacity as well as the complexity of the 
protocol. Therefore, this requirement will impose, in all 
cases, an upper boundary K max on k (i.e., k< K max ). 

Scanning-based binary access 

In order to maximize the value of K max , feedback systems 
with varying degrees of complexity have also been devel- 
oped. Some of these are designed to remind the user of the 
protocol's guidelines [11], while others, relying on peri- 
odic sensory cues, may completely eliminate the need for 
memorization [12]. This latter category includes all scan- 
ning access methods, commonly used by Disabled people 
nowadays. With scanning methods, all possible outcomes 
are presented to the user, at once, by means of a sensory 
pathway (usually visual and/or auditory). During opera- 
tion, the outcomes are automatically highlighted, one by 
one, at a given rate according to the user's abilities. In 
order to indicate intent, users are required to activate the 
binary interface whenever their desired outcome is high- 
lighted. This process results in the generation of time- 
dependent sequences /;(t) similar to the ones depicted in 
Figure 2. However, in contrast to the protocols formerly 
described, there is far more tolerance for variance in the 
period T during which the state of the interface must be 
maintained. Furthermore, because scanning methods rely 
mostly on the feedback information about the state of the 
scanning process presented to the user, there are usually 
sequences /;(£) e S T that correspond to more than one out- 
come q e C. These characteristics make scanning methods 
accessible to a wider variety of users and extend the range 
of potential applications beyond those available with the 
more formal protocols described above. However, scan- 
ning access methods still present a significant drawback: 
the timing of the interaction is controlled by an automatic 
agent, not by the user. Thus, even after the user has already 
decided on the intended outcome, (s)he must still wait 
until this outcome is highlighted by the automated scan- 
ning process in order to communicate the intention. A 
variety of strategies have been proposed to optimize this 
process and therefore reduce the time required for the 
intended outcome to be selected [12,13], however, the 
basic principle remains the same. As a result, with scan- 
ning access methods, it is time, rather than memory capac- 
ity or protocol complexity, that limits the maximum 
number, K mca , of device outcomes that can be made acces- 
sible to the user. 

Synchronous vs. asynchronous binary access 
Because of the external time constraints imposed on the 
user, both protocol-based and scanning-based access 
methods are more generally defined as synchronous in the 



study of human machine interfaces (HMI). Within this 
field, a synchronous access strategy may be defined as a 
method that requires users to comply with one or more 
time constraints in order to communicate intent with a 
minimal interface. This implies that, with synchronous 
access strategies, there will always be an additional delay 
in the process of selection of the intended outcome. 

Conversely, asynchronous access methods do not place any 
time constraints on the users. Thus, users may initiate con- 
trol of the device at any time without having to wait for 
external cues. Furthermore, no protocols are necessary 
because a single interface activation is sufficient to trans- 
mit a full unambiguous message to the device under con- 
trol. Therefore, there is no additional delay in the 
selection of the intended outcome. When using binary 
interfaces, this is easily achievable when the intention 
space only presents two possibilities. That is, when the 
number of possible device outcomes is k = 2. 

Consider, for example, a wall switch with states S = {s 0 : 
UP, s 1 : DOWN} used to select one of the two possible 
outcomes C = {c 0 : ON, c 1 : OFF} of a light bulb. In this 
case, it is possible to map directly each outcome c { e C 
with a particular interface state s f e S in order to establish 
a suitable control strategy: 

c = jc 0 :ON ifs 0 :UP 
C ' jc^OFF ifs^DOWN 

According to Equation (1), every time the position of the 
wall switch changes, the behavior of the light bulb will 
change accordingly. Thus, a single change in the wall 
switch represents a full, unambiguous command sent to 
the light bulb, allowing the latter to respond immediately. 

It has always been assumed that this kind of asynchro- 
nous access is impossible in cases where the number k of 
outcomes C required to control a device is greater than the 
number q of states S available in the interface. However, 
the method presented in this paper may be used with 
minimal interfaces presenting as few as q = 2 stable states, 
in order to access, asynchronously, sets of device out- 
comes of any size k e {2, 3, 4,...}. This includes those 
belonging to analog, as well as multidimensional 
domains, such as the movement parameters of an object 
in a 3-dimensional space. As a result, a variety of activities 
not typically available to Disabled users, may now be 
made accessible to them. 

In the following sections, we provide details on the math- 
ematical development of the proposed method for asyn- 
chronous access, the necessary guidelines for its 
implementation, and an initial evaluation based on a sim- 
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ulated control task. Our concluding remarks and sugges- 
tions for future work, are summarized in latter sections. 

A new method for asynchronous binary access 

To present the proposed method for asynchronous access, 
we will initially focus on the case where a binary interface 
must be used to access a set of outcomes of arbitrary size, 
in order to control a particular device or perform a specific 
task. It is important to note that this analysis was origi- 
nally prompted by the solution of a specific access chal- 
lenge, namely, the development of an appropriate strategy 
to facilitate binary navigation control. In the context of dis- 
ability engineering, binary navigation control consists of 
enabling users to voluntarily define and/or modify the 
motion parameters of an object in space, at any time, by 
means of a binary interface. Binary navigation control is 
thus required to enable most activities involving object 
manipulation with binary interfaces (e.g., single-switch 
drawing). Many such activities are currently inaccessible 
to binary and other minimal interface users. For example, 
when defining suitable alternatives for computer access, 
Shein (1997) described single-switch, computer-aided 
drawing as an exceptionally challenging activity that, 
unlike many other computer-related tasks, may not be 
broken into predictable sequences accessible through 
standard synchronous methods [14]. 

Consider a user who attempts to employ a single button 
(single-switch) to access a device requiring a set C of k > 2 
outcomes. The button, in turn, presents only q = 2 possi- 
ble states S = {s 0 : released, s x : pressed}. Thus, a simple 
mapping strategy such as the one shown in Equation (1) 
may not be used. 

Initially, we may define the transition from state s 0 to state 
Sj (i.e., a button press) as an intentional, user-prompted 
change in the interface. We will call this event . For the 
sake of simplicity, we will assume that the opposite tran- 
sition (i.e., a button release) is not an intentional event 
and thus, will not represent a change in the interface. 

According to the principle of asynchronous access 
described above, every time occurs, the behavior of the 
device must be changed. In other words, a new device out- 
come c e C must be selected. Note that this principle sug- 
gests that the event is only necessary when the behavior 
of the device is unacceptable to the user since this would 
be the only instance where a change in the behavior of the 
device would be welcome. Conversely, if the behavior of 
the device is already consistent with the user's intention, 
the event is not required. In other words, in our example, 
the button should be used to indicate the presence of 
unacceptable behaviors (i.e., errors) in the device through 
the intentional generation of events . 



Let n be the count of consecutive events , and C[„j e C the 
device outcome chosen in response to the n-th occurrence 
of . The fundamental principle of asynchronous access 
may then be simply defined as: 

c [n]* c \n-\] ( 2 ) 

This principle states that when the n-th event occurs, the 
resulting device outcome C[„j must be different from the 
outcome c^.^ preceding it. We call this principle a nega- 
tive acknowledgement (NAK) signaling process because 
the user is required to activate the interface only when the 
device behaves erroneously. This term has been borrowed 
from the analogous error detection, out-of-band, signal- 
ing system for error control, often used in telecommuni- 
cations [15], which, because of its simplicity, has been 
shown to reduce the communication costs (in terms of 
time and bandwidth) in environments with significant 
processing constraints [16]. 

The exclusion mask 

With the exception of Equation (2), there is no additional 
information that could help us determine, precisely, 
which of the remaining elements c # c [ n .\] °f C should be 
selected as the outcome c^ n y The top trace in Figure 3 
shows an alternative graphical representation of this 
knowledge, which may be formally defined as 

*««>-{; 

Here, the element C[„. X ] is assigned a maximum value of 
<Y[„j (c = <:[„_!]) = 1. This value represents an absolute cer- 
tainty that should be excluded from the selection of 
the device behavior C[ n j as stated in Equation (2). Con- 
versely, all other elements share the minimum value 
<Y[„] (c * £[„_!]) = 0, which represents absolute uncertainty 

about their possibility of exclusion from the selection of 
C[„j. Thus, <Y[„] (c), which may only take values in the 

range [0, 1], constitutes a numerical representation of the 
certainty of exclusion of a given outcome c e C from the 
selection of c^. In other words, <Yj„j (c) may be used to 

describe a range of assumptions (from weak X\ n \ (c) — 0 
to strong <Y[ n ] (c) — 1) regarding the unsuitability of out- 
comes in the choice C[„j. This function will be termed the 
spatial exclusion mask of C[„j. 

The representation of the NAK principle in Equation (2) 
by means of the spatial exclusion mask <Yj n | (c) may ini- 
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Sample spatial exclusion masks <Yj n | (c). The top mask represents the fundamental knowledge implied by the principle of 

asynchronous access. Because of its maximum value (c = c [n _|]) = I, the element c [n _|] cannot be chosen when selecting a 

new device outcome c [n j. The bottom mask represents the assumption that outcomes similar to c [n _ , -j should also be excluded 
from the selection of c [n] . 



tially seem unnecessary. However, as it will be demon- 
strated in the following sections, this mask introduces a 
framework for the numerical representation of contextual 
knowledge that may be used to optimize the choice C[„j in 
response to a single binary event . 

Spatial assumptions 

In any typical access problem, it is expected that the set of 
outcomes required to control a device may be numerically 
arranged in a domain where the distance between similar 
outcomes is shorter than the distance between dissimilar 
ones. In that case, outcomes in the neighborhood of c, n .^ 
would be expected to resemble c^.jj. This expectation has 
an important implication in the definition of the spatial 



exclusion mask <Yj n | (c) because it suggests that all those 
outcomes near (i.e., similar to) c^.jj should also be given 
high (i.e., <Y[„j (c) — 1) values of exclusion from the selec- 
tion of the outcome C[„j. This is because it may be assumed 
that outcomes in the neighborhood of c^.jj are too similar 
to to cause a significant change in the behavior of the 
device. This assumption, however, is not as certain as the 
fundamental principle in Equation (2), because it is not 
directly implied by the event . Moreover, the certainty of 
this assumption should be lower for outcomes that are far 
apart from c, n .^ than for outcomes that are closer to 
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Thus, a suitable spatial exclusion mask <Y[„j (c) represent- 
ing these assumptions may be: 

1 - — if r < a, 

0 ifr>a s 
where r =|c - c^^j | is the distance between a given out- 
come ceC and the outcome c^.^ e C preceding the n-th 
event . In turn, a s is a positive integer used to define the 
support boundaries Cr n _^ ± a s of X^ (c). The bottom trace 

in Figure 3 depicts the updated spatial exclusion mask 
defined in Equation (4). Note that in the limit a s — > 0, 
Equation (4) will become Equation (3) as depicted by the 
top trace in Figure 3. 

Evidently, the introduction of the exclusion mask X^ (c) 

suggests that the best choice of C|„| will be the element c e 
C that minimizes <Y[„] (c) (i.e., C[„j = argmin X^ (c)). In 

both cases presented (Figure 3), there is more than one 
element c that fulfills this condition, thus, the selection of 
C|„] is still ambiguous. However, note that the updated 

mask <Y|„] (c) described in Equation (4) reduces the 

number of eligible outcomes c e C to those that lie 
beyond the support limits c^.^ + a s of the spatial exclu- 
sion mask. In fact, if a s is large enough, a unique solution 
may be found. The significance of this reduction in the 
number of eligible outcomes for the choice C[„j will be evi- 
dent in later discussions. In the meanwhile, note that any 
function X^ (c) with support limits c^.j] + a s that 

decreases monotonically from c^ n _^ to c^.^ ± a s , may be 
used to represent the spatial assumptions described 
above. 

Temporal assumptions 

The spatial exclusion mask X^ (c) in Equation (4) repre- 
sents a series of assumptions, with varying degrees of cer- 
tainty, that outcomes in the spatial neighborhood of c^.j] 
should not be eligible in the selection of the subsequent 
device behavior c [„j. Similarly, these assumptions may be 
extended, starting with the outcome c^.jj, back in time 
throughout the past history {C[„_ 2 ], C[„_ 3 ], C[ n _ 4 j,...} of 
selected outcomes. Thus, as in the spatial case, outcomes 
in the temporal neighborhood of c, n .^ (i.e., immediately 



preceding c^.jj) should also share a high value of exclu- 
sion from the choice Cy n y while outcomes that belong to 
the remote past history of c^.jj should be assigned lower 
values. This is because we may assume that if the recently 
chosen outcome c^.^ has already been excluded, there is a 
high level of certainty that this outcome will not be 
desired in the near future. However, over time, this out- 
come should be made available. Evidently, extending this 
assumption through time requires a memory process that 
enables the storage of historical information on all out- 
comes preceding the n-th event . This information must 
then be available at the time t[ n j, when this event occurs, 
in order to inform the selection of c^. The spatial exclu- 
sion mask <Y[„] (c), introduced above, cannot be 

employed for this purpose since it only describes assump- 
tions valid at t[ n j without providing any means to describe 
assumptions associated with the set of past events {n-l,n- 
1, n-3,...}. Thus, an additional mechanism that enables 
the incorporation of historical information in the choice 
C[„j becomes necessary. 

The exclusion estimate 

Consider the function Y(c, t) depicted in the discrete time 
sequence presented in Figure 4. This function describes 
the viscoelastic deformation of the 1 -dimensional 
domain composed of all elements c e C. The figure shows 
parallel bands representing the state of the domain at reg- 
ular time intervals. In order to elucidate the progression of 
time, the bands have been colored from dark to clear cor- 
responding to the transition from older to more recent 
states of the domain. We will assume Y(c, t) has been left 
undisturbed for a long time t <t[„]allowing it to maintain 

its natural at state (i.e., Y(c, t <t[„]) = 0 for all possible out- 
comes c e C). Then, at a given time t = t[„j, the domain is 
subject to a deformation X^ (c) as depicted by the bot- 
tom trace in Figure 3. By definition, the viscoelastic defor- 
mation process would allow Y(c, t) to recover its natural 
state. However, as depicted by subsequent bands, this will 
only happen gradually over time. 

The sequence in Figure 4 depicts the temporal memory 
effect inherent to the mechanical property of viscoelastic- 
ity. Note that this property fulfills the requirements stated 
in the previous section for the incorporation of temporal 
assumptions in the choice C| n j. In particular, in the context 

of asynchronous access, the deformation Y(c, t) subject to 
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Figure 4 

A discrete time sequence of the viscoelastic deformation of the I -dimensional domain C depicted by function 

Y(c, t). The deformation X^ (c), occurring at time t [n] , experiences a steady decay over time. 



consecutive disturbances X^ (c), would allow recent 
assumptions <Y[„j (c) (i.e., those in the temporal neigh- 
borhood of <;[„_!]) to be assigned higher values of exclusion 

than former ones. In other words, the function Y(c, t) may 
be used to record the the full set of historical assumptions 
represented by all spatial exclusion masks 
{X[ n -i\(c)>X[ n -2]{c)>X[n-3]{ c )-} preceding the n-th event . 

A simple recursive algorithm may be used to represent this 
process. 

Let At be the period between the time t[„] of the n-th event 
and the time ([„_!] of the preceding event, that is 

At = t [B] - t K i| (5) 
and Y[ n |(c) the function Y(c, t) evaluated at time t[„j, that is 
Y |n] (c)=Y(c,t = t M ) (6) 



The spatial and temporal assumptions previously intro- 
duced may then be represented, simultaneously, as the 
occurrence of disturbances X^ (c) on Y[„](c) with viscoe- 
lastic decay "H\ n ] (At) 

Y [n] (c) = < H,„ ] (A0T,„_ 1] ( C ) +X [n] {c){l -<H, n] (A0Y K1] ( C )} 

(7) 

We will refer to Y[ n ](c) in Equation (7) as the exclusion esti- 
mate of the current choice C[„j. Note that, Y| n j(c) is defined 
recursively in terms of the exclusion estimate Y[ n . 1 ](c) of 
the previous choice All functions Y, X and H are 
constrained to the range [0, 1]. The function 'H^(At), 

used to apply a viscoelastic decay on Y^.^c), should 
decrease monotonically with increasing values of At. A 
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suitable choice for "H^ (A(t) may thus be the family of 
functions 



9i [n] {At) = e 



-At /T 



(8) 



where r is a time constant always greater than zero. The 
exponential decay described in Equation (8) derives from 
the behavior of real viscoelastic systems such as the dis- 
charge of an electric capacitor or the restoration of a 
mechanical shock absorber [17]. In all these cases, the 
constant r is termed the viscoelastic constant and it is 
directly proportional to the duration of the viscoelastic 
restoration of T^(c). 

Note that <Y|„j (c) and *H[ n ] (At) are weighting functions 

acting on the spatial and temporal domains, respectively, 
of the exclusion estimate Y^(c). While the spatial exclu- 
sion mask A"[„] (c) ensures that outcomes similar to c^.jj 



are excluded from the choice C[„j, the function f-([ n ] (At) 

ensures that recent exclusion estimates T(c, t) are remem- 
bered while old ones are forgotten. Thus, ( H\ n \ (At) is our 

temporal exclusion mask. Note that the support of H [„] (At) 

is defined for values in the range [0, a t ] with a t > 0. In the 
case of the family of functions in Equation (8), a t = go. 

The definition of the exclusion estimate T| n |(c) in Equa- 
tion (7), which now integrates spatial and temporal 
assumptions, suggests that the best possible choice of C[„j 
should be the element ceC that minimizes T^(c). Thus, 



C [n \ = argmin Y |n] (c) 



(9) 



Figure 5 shows a discrete time sequence of the evolution 
of Y(c, t), according to Equation (9), where three different 
events occur at consecutive times. Note that it has taken 
only two events , with corresponding exclusion masks 



X\n-l\(c) 




[n] 



-[n-1] 



Figure 5 

Discrete time sequence of the evolution of the exclusion estimate T(c, t) according to Equation (9). Three con- 
secutive events are presented at different intervals. 
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<Y[„_ 2 ] (c) and X\ n -\\ (c), for Y(c, £) to converge from a 
state of absolute uncertainty for t <t[„_ 2 ]< to a unique solu- 
tion c {n . n at t = t [n . iy 

Equation (9) summarizes the decision process proposed 
for the asynchronous selection of a new device outcome 
C[„] e C in response to a single binary event , consisting, in 
our example of single-switch access, of an intentional but- 
ton press. Thanks to the assumptions incorporated in 
<Y[„] (c) and ( H\ n \ (At), the number of eligible device out- 
comes in the choice C|„j is significantly reduced. In fact, 
with the appropriate parameters, Equation (9) will con- 
sistently converge to a unique solution soon after the 
interaction between the user and the device under control 
is initiated. 

The process for asynchronous access presented here incor- 
porates a number of desirable properties that make it easy 
to implement and adaptable to a wide variety of contexts. 
Among these properties are: 

• There are no restrictions on the time at which a particu- 
lar event may occur. For users, this translates into the abil- 
ity to respond immediately to a change in their intentions 
or an unexpected external disturbance on the device under 
control. 

• The recursive nature of the exclusion estimate T^(c) 
eliminates the need for the implicit calculation of the 
effects of the set of historical assumptions 
{*[n-i](4*[n-2](4*[n- 3 ]( c )<---} on the selection of c [n] , 
thus reducing the processing power and memory storage 
capacity required for the implementation of the proposed 
method for asynchronous access. 

• There is no limit on the number k of outcomes C that 
may be made available to the user through this method. 
In fact, the set C may be defined as a continuous interval 
of all possible real valued outcomes c e [c min , c max ], where 
c min and c max are the lower and upper boundaries of C, 
respectively. Evidently, in this case, k=co. 

Summary 

1. According to Equation (2), when the n-th event occurs, 
the device outcome c [„j must be different from the out- 
come c [„_! ] immediately preceding it. In other words, there 
is absolute certainty that c ^.^ should be excluded from 
the selection of c [„j. Thus, the event , which represents a 
voluntary, user-prompted change in the interface, should 
be employed by users as an error indicator. This requires 



users to generate events every time the behavior of the 
device is inconsistent with their intentions. 

2. Even though the exclusion principle in Equation (2) is 
the only knowledge implied, with absolute certainty, by 
the occurrence of event , it is also possible to assume, 
although with a lower degree of certainty, that behaviors 
similar to c^.^ should also be excluded from the selection 
of C[ n j. This assumption is defined by the spatial exclusion 
mask <Y[„] (c), a function with values in the range [0, 1] 

and support c^.jj ± a s , decreasing monotonically from 
<Y[„] (c = C{ nA ^ = 1 (i.e., the strongest assumption of exclu- 
sion) to <Y[„] (c = c^.jj ± a s ) (i.e., the weakest assumption 

of exclusion) as candidate outcomes c e C become 
decreasingly similar to 

3. It may also be assumed that device outcomes resulting 
from recent selections (i.e., immediately preceding the n- 
th event ), should be excluded from the selection of C|„|, 
while outcomes that belong to the remote past of n should 
become eligible. The incorporation of this assumption is 
made possible through the introduction of the exclusion 
estimate Tj n j(c) and the temporal exclusion mask 
< H|„](At), where At is, according to Equation (5), the 

period between the time t[„j of the n-th event and the time 
t[„.!] of its predecessor. According to Equation (7), the 
exclusion estimate Y[ n |(c), which is recursively defined in 
terms of the exclusion estimate Y^.^c) of the preceding 
event, acts as a viscoelastic domain storing the set of his- 
torical deformations {<Y[ n ](c),<Y[ n _ 1 ](c)„Y[ n _ 2 ](c)/---} sub- 
ject to a viscoelastic decay described by the temporal 
exclusion mask r H^[At). Thus, 'H^(At) must decrease 

monotonically from X^ n \ (At = 0) = 1 to (At = go) = 0. 

Note that the functions <Y[„] (c) and < H|„](At) act as 

weighting masks on Y| n ](c) updating the certainty of exclu- 
sion, from the choice C[„j, for every candidate outcome c e 
C, according to reasonable spatial and temporal assump- 
tions, respectively. 

4. Once the exclusion estimate T| n j(c) is calculated, it will 
be possible to make an informed decision regarding the 
best possible choice of C[„j e C according to Equation (9). 
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Implementing the proposed method 

In order to successfully implement the method for asyn- 
chronous binary access presented above, some additional 
considerations are required. 

Initialization 

Note that the decision process described in Equation (9) 
does not specify the characteristics of the exclusion esti- 
mate Y[ 0 j(c) before the first (i.e., n = 1) event is generated 
by the user. In fact, there is no information regarding the 
value of the initial device outcome c [ 0 j either, and without 
this knowledge, the recursive process described in Equa- 
tion (7) may not be initialized. Thus, even before the user 
initiates interaction with the device, a virtual selection Cr 0 ] 
must be made. Similarly to the case where the concept of 
viscoelasticity was first introduced, we may assume that 
before the first user-prompted event (i.e., t <t[i]) the exclu- 
sion estimate had been left undisturbed for a long time, 
thus allowing it to recover its natural flat state. That is, 
Y| 0 j(c) = 0 for all outcomes C[ 0 j = ceC, Moreover, since all 

values c e C fulfill the condition in Equation (9), we 
would then be obliged to draw C[ 0 j from a uniform distri- 
bution of C. Consequently, this random selection of C[ 0 j 
may be used to initialize the decision process Equation 
(9). Note that it is not necessary to communicate the vir- 
tual choice C[ 0 ] to the device under control. Thus, the 
device may remain undisturbed until after the first user- 
prompted event occurs. In this case, the virtual choice C[ 0 ] 
will only be used to obtain the first exclusion mask 
<Y[!] (c) at ([j], enabling the calculation of the estimate 

Y| 1 j(c). The resulting outcome c^j will then be the first to 
affect the device's behavior. From the perspective of the 
user, it will appear that the outcome has been drawn 
randomly from a uniform distribution. However, as 
explained here, this is only the case for the virtual choice 
c [ 0 ], since, according to Equation (9) will be drawn 
from a more restricted distribution where a subset of the 
elements c e C (i.e., ~ C| 0 j + a s ) have already been 
excluded. 

An alternative (and, in fact, more useful) procedure con- 
sists of initializing Y[ 0 j(c) with random white noise in the 
interval of real numbers [0, 1]. This minimizes the proba- 
bility of having multiple candidates for the virtual choice 
C[ 0 j, since it is expected that, after this initialization, Y[ 0 ](c) 
will present a unique minimum value, which may then 
constitute the virtual choice C[ 0 j. The advantage of this 
method over the one initially proposed, resides in the fact 
that with the latter, Y[ n j(c) will more likely converge to a 



unique solution from the beginning (i.e., n = 1) of the 
interaction. In fact, this also allows for the prediction of 
future selections of C[„j e C with a significant degree of 
confidence. 

Anchorage 

If the viscoelastic constant r is too long, or a significant 
number of events occur in a short amount of time, the 
exclusion estimate Y[ n ](c) may accumulate constant off- 
sets from previous, but still remembered deformations 
X(c). Due to the discretization process inherent to any 
numerical implementation of the proposed method (e.g., 
on a computer), this offset accumulation may in fact cause 
saturation of the exclusion mask T^(c). That is, Y| n ](c) — 

1 for all outcomes c e C. If saturation occurs, the informa- 
tion storage capacity of the exclusion estimate will be 
completely eliminated, thus, preventing the selection of 
reasonable outcomes c [„j derived from the spatial and 
temporal assumptions introduced before. 

In order to prevent the occurrence of saturation, constant 
offsets must be eliminated at all times from the exclusion 
estimate T^(c). This may be achieved by subtracting the 
value of Yj n |(c = C[„j) from the function Y[ n |(c). That is 

Y [n] (c)^Y [n] ( C )-Y w ( C = C[n] ) (10) 

where Y[ n j(c = C[„j) is the value of Y| n |(c) evaluated at the 
recently obtained outcome C[ n j. Evidently, if Y| n |(c = c^) is 
already zero, Equation (10) will have no effect on Y[ n |(c). 
This process of elimination of the offset of the exclusion 
estimate Yj n j(c) is termed anchorage. The process of 
anchorage has no effect on the decision C[„j, since this 
decision only depends on the relative exclusion value of a 
given outcome csCas compared to the rest of the ele- 
ments of C. 

Algorithm 

The following list summarizes the sequential steps 
required for the implementation of the proposed asyn- 
chronous access method. 

1 . Originally, nothing is known about the intention of the 
user regarding the behavior of the device. Thus, the exclu- 
sion estimate Y| 0 ](c) may be initialized with white noise in 
the range [0, 1]. This results in the definition of the virtual 
choice c [ 0 j and the exclusion mask (c), which precede 

any user interaction and, therefore, any change in the 
behavior of the device. 
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2. When the n-th intentional binary event occurs, the 
period At is calculated according to Equation (5) and used 
to obtain the decay ( H\ n \ (At) through a suitable function 

such as Equation (8). Subsequently, the intention esti- 
mate Y[„](c) is updated according to Equation (7). 

3. The corresponding n-th device outcome c [„j may now 
be obtained according to Equation (9). This outcome is 
immediately transmitted to the device which experiences 
a change in behavior. 

4. The exclusion estimate Y[ n ](c) is anchored according to 
Equation (10). 

5. The exclusion mask <Y[„] (c) is updated to <Y[ n+1 ] (c) 
through a suitable function such as Equation (4). 

6. For subsequent events , the process is repeated from (ii) 
above. 

In addition, the fundamental spatial and temporal 
assumptions require their corresponding exclusion masks 
<Y[„] (c) and *H|„] (At) to have the following properties: 

• The spatial exclusion mask (c) must decrease 

monotonically from <Yj„] (c = c^ n _^) = 1 to <Y[ n ] (c = c^.jj + 

ce s ) = 0. The support of this function will be defined in the 
range [c [n . iv a s , c [n . x] + a s \. 

• The temporal exclusion mask *H| n ] (At) must decrease 

monotonically from "H^ (At = 0) = 1 to "H^ (At = a t ) = 

0. The support of this function will be defined in the range 
[0, a t ] where a t > 0. 

Note that although these assumptions are reasonable 
given the access problem proposed, there is no limit to the 
number and/or kind of assumptions that may be incorpo- 
rated into /Y|„j (c) and *H[ n ] (At). For example, one could 

deliberately exclude a particular outcome c x e C (i.e., 
^[n] ( c i) = 1) or all events occurring before a certain mem- 
ory threshold At 0 (i.e., f~i[ n ] (At < At 0 ) = 0) in response to 
some contextual knowledge. 

Evaluation 

We have presented a method for asynchronous binary 
access based on the selection of a particular outcome C[„j 



that may be immediately transmitted to the device under 
control in response to the single n-th binary event . How- 
ever, we have not yet given any consideration to the case 
when the selected outcome C|„] e C is inconsistent with the 
user's intention. This is, in fact, a very likely possibility if 
we consider that, according to the NAK signaling process 
previously described, by generating the event the user is 
simply requesting a change in the behavior of the device. 
However, there are no means to specify which of the out- 
comes ceC will be the most appropriate. Thus, if the out- 
come C|„| e C chosen after the n-th event is unacceptable, 
the user will be required to generate another event hoping 
to obtain the desired outcome with the subsequent choice 
C[ n+1 | e C. Users will be required to repeat this process 
until the behavior of the device is consistent with their 
intention. 

For the typical binary interface user, generating the event 
will require some kind of effort. Thus, measuring the 
number of events required to reach a particular target out- 
come c y e C would provide a benchmark for the evalua- 
tion of the cost associated with the proposed method. 
Note, however, that this measure arises from a naturally 
uncertain (i.e., stochastic) process and thus, may only be 
described in terms of probability. 

Let N be the number of intentional binary events required 
to reach a series of typical target outcomes c y e C, it is pos- 
sible to measure the fraction P(N<X) of targets c y that will 
require X or less events to be reached. This is known in 
probability theory as the cumulative distribution function 
(CDF) of the random variable N [18]. 

Figure 6 depicts a sample CDF corresponding to two dif- 
ferent processes of selection of a specific outcome c, drawn 
from a uniformly distributed set C of size k = 8, in 
response to consecutive binary events . Both processes fol- 
low a geometric distribution with CDF defined as 

P(N<X) = 1 - (1 -py (11) 

where p is the probability of making a correct choice for 
any given attempt. 

The lower trace in Figure 6 (i.e., p = 0.125) results from a 
selection with substitution where all outcomes c e C are 
eligible on every trial n. Conversely, the trace with p = 
0.143 results from a selection without substitution where 
the outcome c^.jj is eliminated from the n-th trial. This 
reduction in the number of eligible outcomes in the 
choice C[„] increases the probability p of making a correct 
choice at any given trial n. Thus, as indicated by the 
dashed lines, with the latter process of selection without 
substitution, there is a marginal gain in the fraction P(N < 
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X 

Figure 6 

Cumulative distribution functions obtained from the process of selection of a given outcome c e C subject to a 
fractional tolerance cr = 1 0% of the full range of C. The lower gray trace corresponds to a selection with substitution 
with probability of success p = 0. 1 . The middle gray trace corresponds to a selection without substitution p = 0. 1 I and the 
upper black trace corresponds to the proposed method for asynchronous access with parameters co = 0.05, r = 5}. 



X] of targets c y that may be reached with X = 10 or less tri- 
als. The process of selection without substitution 
described above, is identical to the fundamental principle 
of asynchronous access presented in Equation (2), which 
describes the selection of a new device outcome C[„] in 
response to the user-prompted event . Thus, as demon- 
strated in Figure 6, the incorporation of the knowledge 
implied by this principle, translates directly into a reduc- 
tion of the cost associated with the use of the device (i.e., 
a reduction in the expected number, N, of events required 
to reach a target outcome c y ). Similarly, it would be desir- 
able to evaluate the impact that the additional assump- 
tions /Y[„] (c) and "H^ (At), incorporated in the exclusion 

estimate T^(c), may have on the cost of use of the device. 



However, the CDF associated with these assumptions is 
not easy to obtain since it depends on a variety of param- 
eters specific to the particular context of application. Thus, 
in order to evaluate the performance of the proposed 
access method, we completed a series of simulations for a 
select case of device control by a binary interface user. 

Methods 

In order to determine the expected impact on the cost of 
use of a device associated with the proposed method for 
asynchronous binary access, a Monte Carlo simulation 
[19] of a simple access task was performed. In this simu- 
lated environment, a computer model of a typical user 
was implemented. This model user was then required to 
employ a single binary interface in order to select a series 
of predefined targets c y from a set C of k = 100 outcomes 
required to control a device (e.g. the volume of a TV). It 
was assumed that the main mode of monitoring the 
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behavior of the device by the model user was visual. Thus, 
as soon as the model user 'observed' that the behavior of 
the device was inconsistent with the required target, an 
intentional event would be generated. A total of 1000 ele- 
ments c y were initially drawn randomly with replacement 
from C in order to establish the predefined sequence of 
target outcomes that the user was required to select in 
order to successfully control the device. It is important to 
note that real access applications are likely to involve 
sequences of correlated actions rather than independent 
ones. Thus, our choice of random, uncorrelated targets 
represents an extreme case likely to constitute a lower 
boundary of performance for the proposed access 
method. 

Each target in the sequence was presented to the model 
user until it was reached. Then, the next target in the 
sequence was presented, and so on. The objective of this 
simulation was to measure the number N of intentional 
events that would be required from the user in order to 
reach each target c y . This process was repeated 6 times for 
a total of 6000 targets per trial. This number was sufficient 
to quantify the statistical nature of N and obtain an esti- 
mate of its CDF for each case evaluated. 



t r of this user's reaction time was ~213 ms, which is con- 
sistent with previous research on the topic [20]. Thus, it 
may be assumed that the statistical model, represented by 
the histogram obtained, was an accurate estimate of user 
behavior incorporating the stochastic nature of the inter- 
action between a real user and a device. 

Cases for evaluation 

According to the proposed method of asynchronous con- 
trol, there are few restrictions to the definitions of the 
exclusion masks (c) and "H^ (At). As a result, there 

is an infinite number of functions that comply with the 
basic requirements of both of these functions. We will 
focus on the evaluation of a single family of functions for 
each of the exclusion masks defined. These functions have 
already been introduced and correspond to some of the 
simpler sets of assumptions that may be made in compli- 
ance with the necessary requirements for the linear spatial 
exclusion mask <Yj n ] (c) in Equation (4) and the exponen- 
tial temporal exclusion mask "H^ (At) in Equation (8). 



Modelling the user 

As mentioned before, it was assumed that the model user 
was able to monitor the behavior of the device under con- 
trol through visual means. This process would involve a 
series of delays as a result of the time required by the user 
to process the visual information and, if necessary, gener- 
ate the event . Thus, in order to obtain an accurate model 
of the visual reaction time t r , which includes both the vis- 
ual perception and motor reaction times, an initial exper- 
iment was performed with a real user. During this 
experiment, the real user was requested to respond to sim- 
ple visual stimuli presented on a computer screen. The 
stimuli consisted of the appearance of a white circle on a 
black background after random delays of 1 to 3 seconds. 
The user was instructed to press a button (defined as the 
event ) immediately after the stimulus (i.e., the white cir- 
cle) appeared on the screen. The experiment was per- 
formed using the open source software package PXLab, 
which can be used to accurately measure the user's reac- 
tion time t r defined as the period from the presentation of 
the stimulus, to the generation of the intentional event . A 
histogram of the reaction times, t r , was obtained with a 
total of 100 trials. This histogram was used to represent 
the model user in the Monte Carlo simulations intro- 
duced above. Thus, for each event , a reaction time, t r , was 
randomly drawn from the histogram. The expected value 



Each case for evaluation was defined by a set, 9 , of three 
parameters: 

• The tolerance a of the choice C[„j. This parameter was 
used to define a boundary around the target outcome c y 
within which the choice C[„j was considered acceptable. In 
other words, the target outcome c^was reached if 



z max c min 



CF 

< — 

2 



(12) 



• The width co = a s ■ (c max - c mir ^)- 1 of the linear spatial exclu- 
sion mask <Y|„] (c). This parameter specified the fraction 

of the full length of C defining the support boundaries of 
/Y[„] (c) as defined in Equation (4). 

• The viscoelastic constant r of the temporal exclusion 
mask ( H\ n \ (At) as defined in Equation (8). This parameter 

defined the expected size, in seconds, of the memory win- 
dow of the exclusion estimate Y[ n j(c). 

Table 1 shows the admissible and selected test values for 
all parameters in 6 . In the context of this simulation, a 
represented a requirement of the particular device under 
control while a and v characterized the algorithms 
employed to enable access to the device. In other words, 
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Table I : Admissible and test values for the parameter set 0 evaluated 



Parameter 


Admissible Values 


Test Values 


<T 


[0, I] 


{0.05, 0. 1 , 0. 1 5, 0.20} 


CO 


[0, 00] 


[0.02, 0.2] in regular increments of 0.0 1 


T 


[0,00] 


t = e z where z e [-2.5, 3.75] in regular increments of 0.25 



the simulation evaluated the performance of a number of 
algorithms described by co and r on the solution of partic- 
ular access problems with a cr requirement. The test values 
for the parameter set 6 were selected according to gener- 
alized but expected contexts of human-machine interac- 
tion, within relatively broad intervals. Thereore, this 
simulation may only be used to characterize the general 
properties of the proposed method for asynchronous 
access. In order to evaluate the performance of this 
method in specific applications, more complete simula- 
tions incorporating the appropriate parameters are neces- 
sary. 

In total, 1976 sets 6 = {a, co, r} were evaluated, and, as 
mentioned before, each set consisted of 6000 separate tri- 
als where the model user was requested to reach a specific 
target causing a single binary interface and the proposed 
method for asynchronous access. 

Performance measure 

According to Figure 6, for every possible value of X, the 
value of the fraction P(N < X) will be higher for algorithms 
that reduce the cost of access when compared to a simple 
random selection with substitution. Furthermore, the 
higher the value P(N < X), the more cost-effective the asso- 
ciated algorithm will be. Therefore, if the differences 
between the corresponding values P(N < X) for a given 
algorithm and a simple random selection are accumulated 
over X, it will be possible to obtain an overall score for 
each of the cases evaluated. We defined the overall score 
r(0) as 

T{0) = Y 4 P e {N<X)-Y 4 \-{\-a) x (13) 

x=i x=i 
where P g (N < X) is the CDF obtained for a particular set 

6 = {a, co, t). Note that T is a relative measure of perform- 
ance with reference to a process of random selection with 
substitution subject to the given tolerance cr . This latter 
process is captured by the second term in Equation (13) 
and defined in Equation (11). In the limit X — > go, both 



terms of the subtraction tend to 1 thus, in practice, it is 
only necessary to consider a sufficiently large number for 
X. For example, in the case presented in Figure 6, the value 
X = 40 would be an appropriate limit for the summations. 

According to Equation (13), positive values of T( 6 ) indi- 
cate lower usage costs. Thus, in order to optimize the cost, 
r( 0 ) must be maximized. Conversely, negative values of 
r( 0 ) would indicate a disastrous performance (i.e., even 
worse than a random guess). Finally, a value T{6 ) = 0 

would indicate similar performance between a random 
guess and the proposed algorithm with the particular 
parameter set 6 . However, in such cases, the additional 
complexity of the proposed method would not justify its 
application. Thus, these sets should also be avoided. 

Results and discussion 

Figure 6 presents the CDF resulting from a single case 9 = 

{a = 0.1, co = 0.05, t = 5} as compared to the CDF 
obtained from a simple selection from a uniform distribu- 
tion, with (p = 0.1) and without (p = 0.11) substitution, 
subject to the same tolerance requirement cr= 0.1. Note 
that, for a given value X = 10, the proposed method pro- 
vides an advantage in excess of 20% in the fraction P g (N 

< X) of trials completed. 

Furthermore, this method reaches a maximum value 
P g (N < X) = 1 with less than half the events required by 

the other selection processes. In other words, the pro- 
posed method demands over 50% less effort from the 
user. With the parameter values specified above, the value 
of relative performance as defined in Equation (13) was 
r(<2)*4.25 

Figure 7 shows all 1976 cases evaluated. Cases with rela- 
tive performance values lower than zero were plotted here 
as T( 6 ) = 0. Note that only a small fraction of cases exhib- 
ited this unacceptable value of performance. 
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Figure 7 
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Relative performance T for all sets of parameters 0 = {a, co, v) evaluated. The viscoelastic constant rhas a negligible 
effect beyond ~I0 t r . Furthermore, with lower values of tolerance a, the set of acceptable parameters {co, t} is reduced. 
However, the relative gain T may be significantly larger than that obtained with greater tolerances. 



As mentioned before, the results of this simulated experi- 
ment must be interpreted with care. In particular, we have 
identified three significant concerns i) a real application is 
likely to involve other cognitive processes in addition to 
the simple visual reaction time used here to model the 
user, ii) the control of a real device is likely to involve a 
series of correlated targets instead of the independent 
ones proposed in our experiment, and hi) users can fail 
trying to activate the interface and cause a delay, but, 
worst, the user can involuntarily activate it even if (s)he is 
happy with the current choice. 

Regarding the first concern, the reaction time of the user 
will likely be increased in real applications, stretching the 
relative performance measure T in the r axis. However, as 
shown in Figure 7, for all cases, the influence of r is negli- 
gible beyond approximately 10 times the expected user 



reaction time t r . Thus, if a sufficiently large r> 10 • t r is 
chosen, the performance of the algorithm will not be sig- 
nificantly impacted. 

Moreover, with the proposed asynchronous access 
method, the user must only determine whether the device 
is behaving erroneously or not. In most cases, this should 
be obvious to them. Therefore, the actual reaction time 
may not be significantly longer than the simple visual 
reaction time considered in this experiment. 

In terms of the second concern, the use of uncorrelated 
targets drawn from a uniform distribution has likely 
resulted in a lower boundary of performance for the 
experiments carried on here. In other words, the proposed 
method for asynchronous access is expected to have a bet- 
ter performance in a real application. 
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This is because real applications are likely to be composed 
of correlated targets whose spatial and temporal relation- 
ships are approximated by the basic assumptions incorpo- 
rated in X and *W , respectively. 

Finally, in cases where the user involuntarily rejects cor- 
rect behaviors, (s)he will be forced to activate the interface 
a few more times in order to reach, once more, such 
behavior. However, it is important to note that, for the 
proposed example, the algorithm's performance will still 
be subject to the pattern reported in figure 6 even though 
the correct behavior will be placed at the end of the queue 
immediately after an involuntary rejection. That is, it will 
still take X — 1 8 or less interface activations to reach the 
target again. On average, however, this process will take 
longer than with a random selection. Thus, for settings in 
which the probability of false-positives (i.e. involuntary 
rejections) is high, the performance of the algorithm may 
be significantly compromised. The reasons for increased 
false-positive rates in a specific application depend not 
only on the user's ability to maintain a particular selec- 
tion, but also on the performance of the binary interface 
itself. In order to mitigate the incidence of false-positives, 
a variety of strategies can be used ranging from adapta- 
tions of the physical environment (including the inter- 
face) to the implementation of digital filters that 
disambiguate the user's intention. Due to the complexity 
and interdependence among the different factors that may 
influence performance in a specific context, this issue 
must be studied on a case-by-case basis. We will explore in 
detail the real impact of false-positives and its potential 
mitigation in further studies involving real users that 
attempt to control complex appliances using a binary 
interface in combination with the proposed algorithm. 

From the results presented above, one may also observe 
that the number of parameters { co, r} (i.e., the width of 
the spatial exclusion mask and the viscoelastic constant, 
respectively), which result in maximum relative perform- 
ance T, increases with the tolerance cr of the particular 
application. Conversely, the maximum relative gain T, 
obtained with higher tolerances cr, is reduced in compari- 
son to cases where the tolerance is small. Thus, for 
instance, while a wider range of parameters {co, t) is 
acceptable in the case cr = 0.2, the maximum gain 
obtained with optimal parameters { co, t} in the case cr = 
0.05 is significantly higher. This phenomenon represents 
the main trade-off of the proposed method. Thus, in prin- 
ciple, the proposed asynchronous access method may be 
used to determine the behavior of a device with any 
degree of precision; however, higher precision will require 
more rigorous fine tuning of the algorithm parameters { co, 

A- 



In all cases, maximum values of performance were 
reached when co = cr/2. This actually corresponds to the 
cases where the exclusion mask X^ (c), characterized by 

co, corresponded with the actual requirements of the 
application summarized by the tolerance <x Evidently, if 
the tolerance a of a particular application is known, the 
optimal value co = a/2 may be immediately set. However, 
in a real application, this tolerance may not be easily iden- 
tified. Furthermore, tolerance is likely to depend on the 
control priorities of each user in a particular application. 
Thus, for example, within the maximum tolerance for the 
execution of a particular task, some users may be more 
willing to accept errors than others. Nevertheless, the wide 
variety of arrangements available through the proposed 
access method, allows for its adaptation to virtually any 
type of user. 

A sample application 

In order to demonstrate the relevance of the proposed 
asynchronous access method in the control of real appli- 
ances, we implemented a single-switch drawing applica- 
tion termed the one-button doodler [21], this on-line tool 
allows minimal interface users to create "free-hand" draw- 
ings using only the left button of a computer mouse or a 
single keyboard key. Figure 8 depicts a sample drawing 
made by a minimal interface user by means of this soft- 
ware application. A particular implementation of the pro- 
posed method, with spatial exclusion mask <Y[„] (c) 

defined by Equation (14), allowed this user to access a 
total of 180 different angles, allowing a pointer to follow 
the trajectory defined by the depicted trace. Note that, 
given the angular nature of the domain under control, the 
mask introduced here was more appropriate for this appli- 
cation than the mask defined in Equation (4) above. 

*[„]M = |[l + cos(r)] (14) 

We have previously reported that, in order to minimize 
the delay between the user's action and the device's 
response, the outcome is transmitted to the device 
immediately after it is selected. However, in recent exper- 
iments involving real users, it has been evident that this 
immediacy is not as important as the ability to select the 
intended behaviour with high accuracy. Thus, in some 
cases, users prefer to have some time to reject the most 
recent selection proposed by the algorithm. Furthermore, 
since the algorithm becomes highly predictable soon after 
the interaction with the user has been initiated, it is possi- 
ble to display a list of suggested behaviors that will follow 
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Figure 8 

Sample drawing made by a minimal interface user by 
means of the one-button doodler on-line software 
application [2 1]. A particular implementation of the pro- 
posed method, with spatial exclusion mask <Yj n ] (c) defined 

by Equation (1 4), allowed this user to access a total of 1 80 
different angles, allowing a pointer to follow the trajectory 
defined by the depicted trace. 



the most recent selection. When available, this additional 
information can improve accuracy significantly. Full 
results of these and other studies involving real users will 
be reported in subsequent publications. 

Conclusion 

A novel method of asynchronous binary access has been 
proposed. This method translates consecutive intentional 
changes, executed by users of binary interfaces at irregular 
intervals, into increasingly accurate estimates of their 
intention. With this method, users are required to employ 
their interfaces only when the device under control 
behaves erroneously. When this happens, an algorithm 
that incorporates simple spatial and temporal assump- 
tions, regarding all possible device outcomes, is used to 
obtain an informed estimate of the best possible outcome 
that the device should present next. This algorithm is 
based on the mechanical deformation of a viscoelastic 
space that may store the set of historical assumptions pre- 
ceding any intentional event performed by the user. The 
theoretical evaluation of this method resulted in two sig- 
nificant conclusions: 

1 . The proposed method may be used with binary inter- 
faces to asynchronously access devices with any number 
of potential outcomes and, 



2. this method may be optimized through the particular 
choice of the spatial and temporal exclusion masks X and 
<H , according to the particular requirements and contex- 
tual circumstances of each application. 
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